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Abstract: This paper considers two simple pricing schemes 
for selling cloud instances and studies the trade-off between 
them. We characterize the equilibrium for the hybrid system 
where arriving jobs can choose between fixed or the market 
based pricing. We provide theoretical and simulation based 
evidence suggesting that fixed price generates a higher ex- 
pected revenue than the hybrid system. 

1 Introduction 

Cloud computing provides on-demand and scalable access 
to computing resources. Public clouds, such as Windows 
Azure and Amazon EC2, treat infrastructure computing as 
a service that can be purchased and delivered over the Inter- 
net. A user purchases units of computing time on virtual ma- 
chines (referred to as instances). The most commonly used 
pricing mechanism for instances is pay as you go (hence- 
forth, PAYG), where a user is charged a fixed price per unit 
time per instance. However, given stochastic demand, such 
fixed pricing may result in unused resources. Rather than 
letting resources sit idle, the provider could operate a spot 
market, selling unused resources at a reduced price via using 
auction to users willing to tolerate delays and interruptions. 

This paper examines the tradeoffs for a provider deliber- 
ating whether or not to operate a spot market. On one hand, 
operating a spot market can create price discrimination, as 
users with low values and low waiting costs compete for 
spot instances, thereby extracting payments from the users 
who would balk if PAYG were the only option. On the other 
hand, the spot market provides a cheaper alternative to users 
with high value but low waiting cost, causing a loss of rev- 
enue from the users who would have paid a higher PAYG 
price if PAYG were the only option. In consequence, it is 
not obvious if operating PAYG and the spot market simulta- 
neously provides any net gain in the expected revenue to the 
cloud service provider. 

To quantify the trade-offs we construct a simple model of 
a cloud computing service with users who are heterogeneous 
both in their value for service and in their waiting cost. We 
first analyze PAYG and a spot market in isolation and use 
the resulting insights to analyze what happens when they 
operate simultaneously. Our analysis is not tied to any par- 
ticular pricing rule for the spot market. Instead, we use a 
characterization similar to the revenue equivalence theorem 
for auctions fTT) to characterize the expected payment made 
by a user in any equilibrium of any pricing rule. Moreover, 

'This work was done while the author was interning at Microsoft 
Research Cambridge. 



while the analysis of the queuing system with multiple pri- 
ority classes and multiple servers is complex (see, e.g., (6), 
p2) ) an application of the revelation principle [ 1 1 1 allows us 
to circumvent this complexity. We describe a general queu- 
ing system for the spot market purely in terms of a waiting 
time function and exploit its properties for our analysis. Our 
main contributions are: 

• We model a cloud computing service as a queuing sys- 
tem described by a waiting time function and apply tech- 
niques from the theory of optimal auctions to analyze it. 

• We show that, in equilibrium, users have a waiting cost 
threshold that determines whether they participate in the 
spot market or PAYG. Moreover, their bids in the spot 
market are independent of their value for service and in- 
creasing in their waiting cosj^] 

• Using this equilibrium characterization, we provide the- 
oretical and simulation evidence suggesting that operat- 
ing PAYG in isolation provides a higher expected rev- 
enue to the cloud service provider than operating PAYG 
and a spot market simultaneously. 

Our work is at the nexus of queuing theory and game the- 
ory. Hassin and Haviv |8| provide a survey of this area. For 
observable M/M/l queues with identical customers, Bal- 
achandran [|3j derives a full information equilibrium strat- 
egy. Hassin |7| andLui flO) consider unobservable M/M/l 
queues where customers with heterogeneous waiting cost 
bid for preemptive priority using the first price auction. They 
characterize an equilibrium where bids are increasing in the 
waiting cost. Afeche and Mendelson [2| extend this to a 
more general waiting cost function. Dube and Jain |T5} con- 
sider a different problem with competing GI/GI/1 priority 
queues; arriving jobs decide which queue to join. They find 
conditions for the existence of the Nash equilibrium. Per- 
haps the closest to our work are papers that apply the theory 
of optimal auction design to optimize pricing and service 
policies in queuing system. Afeche [ 1 1 shows that delaying 
jobs or choosing orderings that increase processing time can 
increase revenue. Yahalom et al. fl3) generalize JT) by relax- 
ing the distributional assumptions on valuation and working 
with convex delay cost. Katta and Sethuraman [9] design 
a pricing scheme that, under some assumptions, is optimal 
for an M/M/l queuing system and certain generalizations of 
it. Cui et al. |4| move beyond admission control through 
priority pricing. Instead, they consider the problem of joint 
pricing, scheduling, and admission control policy for rev- 
throughout this paper, "increasing" means "strictly increasing." 
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enue maximization for M/M/l queue and find solutions for 
some special cases. Compared to previous work in this lit- 
erature, the distinguishing aspects of our work are: (i) we 
allow for an arbitrary queuing system with multiple servers 
and arrival process which need not be memoryless; (ii) our 
analysis is not tied to a specific auction mechanism for the 
spot market; (iii) we allow PAYG and the spot market to op- 
erate simultaneously are not limited to analyzing a system in 
isolation. 

2 Model 

Consider a cloud computing system where jobs arrive se- 
quentially according to a stationary stochastic process with 
independent interarrival time. Each job demands one in- 
stance and is associated with a distinct user. We will use 
the terms "users" and "jobs" interchangeably. The service 
time for each job is independently drawn according to an 
arbitrary distribution with the expected time of Jobs 
differ in their values for service and the waiting costs. There 
are two classes of jobs. Each job from class i has the same 
value Vi for job completion. Assume v\ > V2- The total 
arrival rate of potential jobs is A x + A 2 . Each job is inde- 
pendently assigned class i with probability A,/(Ai + A2), 
hence the total arrival rate of potential jobs from class i in 
Aj. Each job from class i incurs a waiting cost per unit time 
which is an i.i.d. realization of a random variable Ci with 
the cumulative distribution function (CDF) Fj(c). The exact 
waiting cost of a job is its private information; however, the 
probability distributions Fi's are common knowledge. The 
random variable C/s are independent of each other. If a job 
from class i with waiting cost c pays a total price m for using 
the instance and spends the total time w in the system (the 
sum of the queuing time and the service time, referred to as 
the waiting time) then its payoff is Vi — cw — m. A job wants 
to maximize its expected payoff from using an instance and 
competes to acquire an instance only if its expected payoff is 
nonnegative. Let fi(c) be the corresponding probability den- 
sity function (pdf) of FAc); /,(c) is assumed to be strictly 
positive for c £ [0, fiVi Yj Each job is infinitesimally small 
and cannot affect the system dynamics on its own. 

Modeling PAYG: PAYG is modeled as a GI/GI/ 00 sys- 
tem with service rate fi. A job arriving to PAYG joins imme- 
diately and is served until completion. Each job is charged 
a price p > per unit time for using a PAYG instance. The 
price p is known to everyone a priori. The expected payoff 
of a job from class i with the waiting cost c from using a 
PAYG instance is thus V{ — (c + p) / /i. If c > fxvi — p, the 
job does not participate in PAYG. 

Modeling the spot market: The spot market is modeled 
as a GI/GI /k system with preemption where jobs bid for 
priority. We will be mostly working with auctions where 
a job with a higher bid is given priority over a job with a 



lower bid and can preempt the lowest priority job under ser- 



vice if needed; Section 3.1 provides further details on the 



3 Since the expected service time of a job is 1/fi, jobs from class i 
with waiting cost greater than fiVi will always balk, hence we re- 
strict attention to range [0, fMi]. 



assumptions we make on the relationship between bids and 
priorities. A job which is preempted goes back to the queue 
and waits to resume from the point it left. The queue state 
(i.e., the bid vector in the spot market) is unobservable to 
the arriving jobs. Jobs are not allowed to renege or change 
their bids. A job is charged based its own bid and the bids 
of others according to some spot pricing mechanism. Exam- 
ples include the first price auction where jobs with k highest 
bids are served and each pays its bid, and the (k + l) th price 
auction where the jobs with k highest bids are served and 
each job pays the (k + l) th highest bid. We do not explic- 
itly assume any specific spot pricing mechanism and abstract 
away from it by considering the expected payment by a job 
in a Bayes Nash Equilibrium (henceforth, BNE) using the 
revenue equivalence theorem for auctions fTT) . 

3 PAYG and Spot Market Analysis 
3.1 Strategy, waiting time, and spot pricing 

When a spot market is operating, either alone or in conjunc- 
tion with PAYG, a job that decides to join it participates in 
an auction and must decide how to bid based on the pay- 
ment rules of the auction. The optimal bid may depend in 
a complicated way on its private information (value for ser- 
vice and cost of waiting). However, we show in this section 
that this complexity is inessential. Regardless of the auction 
mechanism, jobs that enter the spot market with higher wait- 
ing costs pay more and wait less time and these values are 
(essentially) independent of the job's class. The job's class 
does matter in determining whether the job participates in 
the spot market, but this take the form of a simple cutoff 
with jobs with waiting costs below the cutoff participating 
and those with costs above not. 

By the revelation principle for BNE [ 1 1 1, it suffices to re- 
strict our consideration to truthful direct revelation mecha- 
nisms: mechanisms where jobs report their private informa- 
tion and it is an equilibrium for them to do so truthfully. Any 
implementable outcome is implementable by such a mecha- 
nism. Thus, a job reports a type (v, c) and if it participates 
in the spot market has an expected waiting time w(v, c) and 
expected payment fh(v, c). In principle, these could depend 
on the value v of the job's class, however, we argue below 
that it is essentially without loss of generality to assume they 
do not. 

LEMMA 1 . For all truthful direct revelation mechanisms 
for the spot market and all equilibria there exists an equilib- 
rium with the same expected utility where expected waiting 
time and payments are independent of class for all values 
of c where both classes participate in the spot market. 

Proof. A job of class i with waiting cost c that partici- 
pates in the spot market chooses a report (V, d) to minimiz- 
ing the expected total cost cw(v' , c')+m(v' , d). Thus, when 
both classes participate, the set of optimal reports is class- 
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independent; in particular, both (v\, c) and (v 2 , c) belong to 
the set of optimal reports. Let si and s 2 be the (randomized) 
equilibrium strategies for class 1 and class 2 with cost c. 
Now, suppose that the job of class i with waiting cost c uses 
strategy s 1 with probability A 1 / 1 (c)/(AiA(c) + A 2 / 2 (c)) 
and strategy s 2 otherwise. Then the arrival process for the 
strategies s\ and s 2 remains identical to the original process, 
hence the waiting time and the expected payment remain un- 
changed. This new class-independent randomized strategy is 
also an equilibrium for both classes. □ 

Since jobs can undo any tie-breaking the mechanism does 
on the basis of class, we assume for the remainder of the 
paper that mechanisms have a class-independent expected 
waiting time w(c) and expected waiting cost m(c). As we 
are interested in what outcomes are implementable, again 
by the revelation principle it is without loss of generality 
to assume that jobs report truthfully and we do so for the 
remainder of the paper. We now show that jobs with higher 
waiting costs pay more and spend less time waiting. 

LEMMA 2. In (the truthful) equilibrium, w(c) is nonin- 
creasing in c and m(c) is nondecreasing in cfor values of c 
that participate in the spot market for some class. 

Proof. Consider c > c. The optimality of truthful re- 
porting implies: 

cw(c) + fh(c) < cw(c) + m(c), (1) 
cw{c) + m(c) < cw(c) + m(c). (2) 

Adding ([T} and |2]) imply w(c) < w(c). Using this and |2]), 

we get to(c) > m(c). □ 

Thus far, our assumptions have been without loss of gen- 
erality. We now make two assumptions that are not. First, 
we assume that jobs with no waiting cost are served for free 
in the spot market, hence m(0) = 0. Second, we assume 
that, in equilibrium in the spot market, jobs with higher wait- 
ing costs always have strictly higher priority than jobs with 
lower waiting costs . Note that this is a stronger condition 
than assuming that w(c) is decreasing. Since w is the ex- 
pected waiting time, if priorities are assigned randomly it is 
possible to have a a strictly lower expected waiting time but 
in some cases a lower priority. All mechanisms that assign a 
strictly higher priority to the jobs with higher bids in the spot 
market, admit an equilibrium where the spot market bids are 
increasing in the waiting cost, and have no reserve price sat- 
isfy these restrictions. For example, we show later in this 
section that the first price auction satisfies these properties. 

We now characterize the participation decision facing jobs. 

LEMMA 3. For each class i there is a cutoff c$ below 
which jobs participate in the spot market and above which 
they do not. 

Proof. A job participates in the spot market if the payoff 
is better than its alternative (0 if the spot market is operated 
in isolation or max{0, Uj — (p + c)/ fi} if PAYG with price p 



is available). The payoff from participation is Uj — cw(c) — 
m(c). Let c be any type that participates. Taking the case 
of the spot market in isolation first, if Vi — cw(c) ~ m(c) > 
then Vi — cw(c) — m(c) > for all c < c. Thus, if 
a job of class i with cost c participates all lower cost jobs 
do as well. This argument also implies that if a job with 
waiting cost c does not participate, then neither does any job 
with waiting cost c > c . Thus, there is some threshold 
Ci below which jobs participate and above which they do 
not. The argument with PAYG as an option is essentially the 
same because the minimum possible value of w(c) is 
the same as the waiting time under PAYG. □ 

In order to characterize an equilibrium where jobs use cut- 
offs (ci, c 2 ), we need to analyze the expected waiting time 
for a job with waiting cost c in the spot market with cutoffs 
(ci,c 2 ). It suffices to characterize some properties of the 
waiting times for arbitrary choices of cutoffs. Given a queu- 
ing system for the spot market, define the waiting time func- 
tion w(c; ci, c 2 ) as the expected waiting time of a job with 
cost c when jobs of class i use cutoff Cj. Note that we are 
defining w for arbitrary cutoffs, not just equilibrium ones. 
The following lemma gives the relevant properties of w. 

LEMMA 4. The waiting-time function w(c;ci,c 2 ) is well 
defined whenever (XiFi(ci) + A 2 i 7 2 (c 2 ))/(fc/i) < 1. It is an 
increasing function of Xi [Fi(ci) — -F\(c)] + +A 2 [-£2(03) — F2(c)] + . 
In particular, this implies: 

(i) w(c;ci,c 2 ) is decreasing in cfor c £ [0, c\ V c 2 Q 
w(c; ci, c 2 ) > if c < c\ V c% and w(c; c\, c 2 ) = 
l/fiifc> c\ V c 2 . 

(ii) w(c; ci, c 2 ) is increasing in c± and cifor ci € [0, fiVi]. 

(Hi) For any C\ > c 2 > c 2 and t £ [c 2 ,Ci], ui(i;ci,c 2 ) = 
w{t;a,c 2 ). 

Proof. The condition (Ai-Fi(ci) + X 2 F 2 (c 2 ))/(kfi) < 1 
ensures the queue is stable so that the expected waiting time 
is finite. This must be true in equilibrium. Since priority 
is given to the job with a higher waiting cost, the expected 
waiting time of a job with waiting cost c depends on the to- 
tal arrival rate of the jobs with waiting cost higher than c, 
and the expected waiting time increases as this total arrival 
rate increases. The total arrival rate of the jobs with wait- 
ing cost higher than c is equal to Ai [Fi(ci) — Fi(c)} + + 
X 2 [F 2 (c 2 ) — F 2 (c)} + . The job with waiting cost great than 
or equal to c\ V c 2 get the highest priority and is served im- 
mediately with no interruptions. Hence, the expected time 
spent by it in the system is 1 ///. The enumerated properties 
follow easily. □ 

Next, we use a characterization similar to the revenue equiv- 
alence theorem for auctions fTT[ and show that the expected 
payment by any job with waiting cost c is uniquely deter- 
mined by the waiting time function w; in particular, it is the 
same for any spot pricing mechanism. 

4 Here, a V b = max{a, b}. 
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Suppose that the truthful reporting with cutoffs (01,02) 
constitutes a BNE for the given spot pricing mechanism. Let 
m(c) be the expected payment made by a job with waiting 
cost c (the expected payment is independent of its class). For 
a BNE to exist, the following incentive compatibility (hence- 
forth, IC) constraint must hold: for any c, c < c\ V C2, and 
any i, 

v l -cw(c;ci,c 2 )-m(c) > v l - cw(c; ci, c 2 ) - m(c). (3) 

By analogy with [ fTT| , we can relate the expected payment 
with the waiting time function w, as follows: 

Lemma 5. A necessary condition for (|3j to hold is: 

m(c) = / w(t;ci,c 2 )dt - cw(c;ci,c 2 ). (4) 
Jo 

Hence, the expected payment by a job with waiting cost c 
is uniquely determined by the function w and is same for 
all spot pricing mechanisms that satisfy our assumption that 
m(0) = 0. 

Proof. (Outline) Let ir(c, c) = (vi — cw(c; c\, c 2 ) — m(c)). 
Then max£7r(c, c) is convex in c and the maximum must 
be achieved at c = c for the IC constraint to hold. A con- 
vex function is differential almost everywhere and the (right) 
derivative of max^ 7r(c, c) with respect of c is — w(c; c\, c 2 ). 
Finally, notice that m(0) = 0; the job with zero waiting cost 
won't pay anything in the spot market because waiting is 
costless for it. □ 

The next lemma shows that the properties of the waiting 
time function along with the expected payment given by Q 
ensure that the IC constraint ([3]) is satisfied. 

LEMMA 6. Lemma^and (|4} together satisfy the IC con- 
straint Q. 

Proof. (Outline) Suppose that the waiting cost of a job 
in class i is c and it instead misreports some c ^ c. The 
expected payoff under truthful reporting is tt(c, c) = m — 
cw(c; c\ , c 2 ) — m(c) and the expected payoff in case of mis- 
report is 7r(c, c) — Vi — cw(c; ci, c 2 ) — m(c). Considering 
the cases c < c and c > c separately, using the property that 
w(t; ci, c 2 ) is decreasing in t, and using Q, we can show 
that tt(c, c) - 7r(c, c) > 0. □ 

Since w(c; c±, c 2 ) is decreasing in c for c £ [0, c\ V c 2 ], 
the proof of Lemma [2] can be used to establish a stronger 
monotonicity of the expected payment m. 

LEMMA 7. Given cutoffs (ci,c 2 ), the expected payment 
m(c) is increasing in cfor c £ [0. c\ V c 2 \ 

3.2 Revenue and equilibria for isolated markets 

First consider PAYG in isolation. If PAYG price is p, a job 
from class i with waiting cost c obtains an expected payoff 
v i ~ (p + c ) /m by using a PAYG instance. A job will partici- 
pate in PAYG if this payoff is nonnegative. Thus, a job from 
class i participates in PAYG if its waiting cost c < [iv^ — p. 



The effective arrival rate of class i jobs is then Ai-Fj(/iUj —p) 
where F^fiVi — p) — if p > fiVi. Each such job uses a 
PAYG instance for an expected duration of and pays p 
per unit time. Hence, the expected revenue to the cloud ser- 
vice provider per unit time, denoted by R pay9 (p), is: 

R P*V9( p ) a P ( Al Fi(^i -p) + A 2 F 2 (m^ 2 -p)) , (5) 
A* 

and the optimal expected revenue per unit time is obtained 
by taking the maximum over p. 

Next, consider the spot market in isolation. Given the cut- 
offs (ci,c 2 ), the expected payment by a job with waiting 
cost c in any BNE is given by Thus, we need to compute 
the cutoff for each class i when the spot market is operated 
in isolation; denote the cutoffs in this case by c s = (cf , c 2 ). 
From Q, the expected payoff of a job from class i with wait- 
ing cost c is Vi — Jq w(t; c s )dt. A job will participate in the 
spot market as long as its expected payoff is nonnegative. 
Hence, the cutoff vector c s must satisfy: 

r n »\jul >0 ifc<cf, 

01 -y <"(*!*■)*{ = if C = C f. (6) 

Theorem[T]below shows that there is an unique cutoff vec- 
tor c s satisfying |6]) and uses it to characterize the BNE for 
the spot market in isolation. 

THEOREM 1. The following holds: 

(i) There is a unique solution to the following system of 
equations in (ari, x 2 ): 

J* 1 w(t;x 1 ,x 2 )dt = vx, 
f* 2 w(t; xi, x 2 )dt = v 2 . 

(ii) Choose the cutoff vector c s as the unique solution of 
d7j. Then c s satisfies |6]), c\ > c, and c 2 < c. Here c 
uniquely satisfies w(t; c, c)dt = v 2 . 

(Hi) In all BNE, a job from class i with waiting cost c par- 
ticipates in the spot market if and only if c < cf. 

Proof. The proof appears in Appendix|A] □ 

To highlight the explicit dependence of the expected pay- 
ment on the cutoffs vector c s , we use m(c; c s ); i.e, 

m(c;c s )= / w(t; c s )dt - cw(c\ c s ). (8) 
^0 

Using Theorem [T] the expected revenue to the cloud service 
provider per unit time when the spot market is operated in 
isolation, denoted by R s , is: 

R s = Ai f 1 m(t;c s )f 1 (t)dt+\ 2 f * m(t;c s )f 2 (t)dt. 
Jo Jo 

(9) 
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3.3 Revenue and equilibria in the hybrid market 

We now leverage the insights gained from analyzing PAYG 
and the spot market each in isolation and move to analyzing 
the hybrid system where both are operated simultaneously. 
As mentioned in Section |3~T] for a given PAYG price p, we 
look for a cutoff vector c(p) = (ci(p),c 2 (p)) such that a 
job from class i with waiting cost c joins the spot market if 
and only if c < c,(p), and if so, it reports its waiting cost 
truthfully; otherwise it joins PAYG as long as c < /j,Vi — p 
(the cutoff for class i if PAYG is operating in isolation). 

A job from class i with waiting cost c gets the expected 
payoff Vi — J Q w(t; c(p))dt from using a spot instance and 
reporting its waiting cost truthfully, while its expected payoff 
from using a PAYG instance is Vi — {p+c) / fi. It will pick the 
one which offers a higher expected payoff. If the PAYG price 
is too high for a class, then no jobs from that class goes to 
PAYG. Theorem |5]below finds the unique cutoff vector c(p) 
and uses it to characterizes the BNE of the hybrid system. 

THEOREM 2. Let c and c s be as given by Theorem [7] 
and p be a PAYG price. Choose the cutoff vector c(p) as 
follows: 

(i) If p £ (0, pv 2 — c], then there is a unique x £ [0, c] sat- 
isfying (p + x)/fi = J Q w(t;x,x)dt. Choose c\{p) = 
C2 (p) = x. Each Ci (p) is increasing in p and Ci (p) £ 
(0,5]. 

(ii) Ifp £ (fiv 2 —c, jiVx— c\ ], then there is a unique {x\, X2) 
such that Xi > x 2 that satisfies the following system of 
equations: 

Jq 1 w(t;x 1 ,x 2 )dt = 
J* 2 w(t;xi,X2)dt = v 2 . 

Choose Clip) — Xi and c 2 (p) — x 2 . C\{p) increases 
with p and c\{p) £ (c, cf], c 2 {p) decreases with p and 
c 2 (p) £ [c|, c), and Ai-Fi(ci(p)) + \ 2 F 2 (c 2 (p)) is in- 
creasing in p. 

(Hi) Ifp > fj,Vi — cf, choose C\{p) = cf and c 2 (p) = c 2 . 

Then in any BNE, a job from class i with waiting cost c par- 
ticipates in the spot market if and only if c < Cj (p), it par- 
ticipates in PAYG if Ci(p) < c < \xvi — p. If \ivi —p< Ci{p) 
then no class i job participates in PAYG^ 

Proof. The proof appears in Appendix [B| □ 

Our analysis so far characterizes a truthful BNE for the 
system where PAYG and the spot market are operating si- 
multaneously. This equilibrium can be implemented by as- 
signing higher priority to the jobs with the higher waiting 
cost and collecting the payment according to Q. In the first 
price auction the bid is same as the payment; a byproduct of 
our analysis is that the payment rule Q and cutoffs given by 

5 We assume that if a job is indifferent between the spot market and 
PAYG, it choses PAYG. This is reasonable as PAYG provides better 
delay guarantees. 
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Theorem [2] characterize the bidding strategy if the first price 
auction is used for the spot market. 

The expected revenue to the cloud service provider per 
unit time is the sum of expected revenue from the spot mar- 
ket and PAYG. From (|5j, |9]), and Theorem[2] given a PAYG 
price p, the expected revenue per unit time for the hybrid 
system, denoted by R h (p), is: 

R h (p) =J2 Xi (v -P) - 



i(p) 



m(t;c(p))fi(t)dt), (11) 



and the optimal expected revenue per unit time is obtained 
by taking the maximum over p. 

The next theorem provides theoretical evidence suggest- 
ing that PAYG in isolation can provide a higher expected 
revenue to the cloud service provider than operating PAYG 
and the spot market simultaneously. 

THEOREM 3. Suppose the optimal price p h of the hybrid 
system is such that p h < \iv 2 — c, i.e., case (i) of Theorem^ 
holds. Then the expected revenue per unit time from PAYG 
in isolation is higher than the expected revenue per unit time 
from the hybrid system; i.e., max p R h (p) = R h (p h ) < 
max p K pay9 {p). 

Proof. Since max,, RP^ ( p ) > i?^^^), it suffices 
to show that 

R pay9 (p h ) > R h (p h ). (12) 

If p h < \iv 2 — c, then c\{p h ) — c 2 (p h ) < c, implying 
fj,Vi — p h >c> Ci{p). Then from <|3j and ( fTTj ), 

i?»W(pfc) _ Rh^h) = X i (^F i (c i (p h )) 



i=l,2 

.(p h ) 



m(t;c^))fi{t)dt). (13) 



At c = Ci{p ), a job is indifferent between PAYG and the 
spot market. Hence, 

c i (p h )w(c i (p h );c(p h ))-rn(c i (p h );c(p h )) = c ^ + p'\ 

A 4 

Since c\{p h ) = c 2 (p h ), w(ci(p h );c(p h )) = l/fj,. Hence, 



m(ci(p h );c(p h )) =p h //j,. From Lemma 



7] m(i; c(p' 1 )) is 



increasing in t for t £ [0, Cj(|>)]. This and ( T3b imply: 



w Jo I- 



fi(t)dt = 0. (14) 



This establishes ( fT2") > and the proof is complete. □ 
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Figure 1 : Expected revenue from PAYG in isolation, the spot market in 
isolation, and the hybrid system as a function of PAYG price. 

4 Simulations 

The revenue ranking result of Theorem[3]is for the case when 
the optimal price p h of the hybrid system is such that p h < 
fiV2 — c. However, we conjecture that the revenue ranking 
result holds in general and present simulation evidence. 

We model the spot market as k parallel M/M/l queues. 
Jobs bid for preemptive priorities using the first price auc- 
tion. An arriving job is randomly and uniformly sent to one 
of the k queues where it is served according to its priority 
order, determined by its bid, in that queue. We extend the 
results from [ 10 1 to compute the waiting time function: 



w(c; ci,c 2 ) 



/x 1 



i=l,2 



(15) 



where pi = \i/{kp). Recall that the payment rule |4} and 
cutoffs given by Theorem|2]characterize the bidding strategy 
for the first price auction for the spot market. The proof of 
Theorem [2] provides a recipe for numerically computing the 
cutoff vector c(p) as a function of PAYG price p. 

Simulations are carried out by randomly generating the 
values of t^'s, Aj's, and k. The service rate pt is kept constant 
at one and Fi is uniform in the interval [0, (ivi\. We gener- 
ate over a hundred random configurations (Uj's, A/s, and k). 
For each realized configuration, we observe that the opti- 
mal revenue from PAYG in isolation is always higher than 
the optimal revenue from the hybrid system where PAYG 
and the spot market are operating simultaneously, even for 
the case where the optimal price p h of the hybrid system is 
greater than pv^ — 5. An example plot where p h > /j,V2 — c is 
shown in Figure [T] Observe that if PAYG price is low, most 
of the jobs in the hybrid system use PAYG and pay a small 
price, leading to a small expected revenue. As PAYG price 
increases, jobs move to the spot market, reaching a point 
where all jobs use the spot market. At p = [1V2, the entire 
class 2 jobs balk from PAYG leading to a kink in the plot 
for PAYG in isolation. Simulations with exponentially dis- 
tributed waiting costs are also consistent the revenue ranking 
that we conjecture. 



5 Discussion and Future Work 

Our analysis in Section [3] characterizes a truthful BNE for 
the system where PAYG and the spot market are operating 
simultaneously. Our theoretical results show that in many 
cases the revenue raised by a PAYG system in isolation with 
a well chosen price p dominates that of this hybrid system. 
Simulations suggest that this may be true in general. How- 
ever, this analysis was based on a number of assumptions. 
We conclude by discussing how relaxing them affects our 
results, which points to several areas for future work. 

• We assumed that the PAYG system has infinite capac- 
ity, which we believe is reasonable given that capacity 
is endogenous and PAYG jobs are more profitable than 
spot market jobs. However, it would also be good to un- 
derstand what happens in situations where this is not the 
case. In cases with excess demand for PAYG instances, 
jobs with high value and high delay cost can compete for 
the spot instances, possibly paying a price higher than 
the PAYG price. However, this can populate the spot in- 
stances and increase the waiting time, possibly causing 
some low value jobs to balk all together. 

• We assumed that the arrival process is independent of 
job type. This may not be true if both arrival pattern and 
value depend on underlying characteristics of the job. In 
this case, it is possible that there are equilibria where 
jobs of different classes but the same cost have different 
outcomes. However, as both classes have the same set of 
optimal outcomes, this requires an amount of coordina- 
tion on tiebreaking that may be unreasonable in practice. 

• Because jobs can get interrupted in the spot market, pro- 
grammers may need to write more robust code and in- 
terruption may be unsuitable for tasks that require high 
availability. This can be modeled as an upfront cost of 
participating in the spot market. Are there reasonable 
scenarios where this makes a hybrid system optimal? 

• We assumed that m(0) = 0. Choosing a larger value 
amounts to setting a reserve price. The equilibrium struc- 
ture would be similar, although the cutoffs would change 
and there are additional cases. Our theoretical revenue 
analysis still holds despite a reserve price. 

• We assumed that the higher priority is given to the jobs 
with higher waiting cost to derive some of the proper- 
ties of the waiting time function w given by Lemma [4] 
This excludes systems where, in equilibrium, a variety of 
types pay the same expected price and receive the same 
expected waiting time (PAYG could be viewed as an ex- 
ample of this). While this would require a more gen- 
eral equilibrium characterization, our theoretical revenue 
analysis still applies. 

• Our analysis is about revenue optimization by a monop- 
olistic provider. Perhaps competitive pressures make op- 
erating a spot market more attractive. 
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APPENDIX 



A Proof of Theorem [T] 

Step 1: Showing that there is a unique c satisfying: 

w(t; c, c)dt = v 2 . 



(16) 



Notice that f* 2 w(t; x\,X2)dt is increasing and continu- 
ous in x\ and X2, J Q 2 w(t; xi,x 2 )dt = for x 2 — 0, and 
f* 2 w(t; xi,x 2 )dt > v 2 for x 2 = fJ,v 2 (w(t; x 1: x 2 ) > 
for t < x 2 ). Hence there is a unique c satisfying ( fT6| ). 

Step 2: Showing that there is a unique solution of the 
system of equations 0. 

If Q has a solution (xi,x 2 ) then x\ > c and X2 < c. 
To see this, first notice that if x\ < x 2 , then (xi , x 2 ) cannot 
be a solution of |7]l (v\ > v 2 ). Hence, x\ > x 2 . Next, if 
x 2 < x\ < c, then u>(t; xi, x 2 ) < w(t;c,c). Then from 
( [To} , J* 2 w(t; Xi, x 2 ) < v 2 , contradicting that (xi,x 2 ) is 
a solution of Q. Hence, x\ > c. Finally, X2 > c can be 
contradicted on the similar lines as above. 

Given any X\ £ [c, fivi], there is a unique x 2 satisfying 
Jq 2 w(t; xi,x 2 )dt = v 2 ; denote it by y{x\). Next we show 
that 4>{xx) = f^ 1 w(t; x\,y[xx))dt is increasing in X\ for 
x\ £ [c,fivi\. Since f* 2 w(t; x\, x 2 )dt is increasing in x\ 
and x 2 , y(xi) is decreasing in x\. Consider x\ > x\. Then, 
[y{xi),xi] c [y(xi),Si], and 



w(t;xi,y(xi))dt - / w(t;xi,y(x 1 ))dt 
o Jo 



iu(t;xi,y(xi))df 

'tet»(xi),xi]\[a(xi),xi] 

/•Xl 

+ / - w(t;x!,y(xi)))dt, 

> / (io(t;xi,y(xi)) - w(t;xi, y(x 1 )))dt > 0, 

where the last inequality follows from Lemma [4] Hence, 
4>(xi) is increasing in xi for xi G [c, nv\). 

Since 0(xi) = «2 for x\ — c, cj){x\) > v\ for x\ = 
[ivi, and 4>(xi) is increasing and continuous in x\, there is 
a unique x\ £ [c, //^i] solving (/>(xi) = uj.. This establishes 
the second part of the claim. Finally, the arguments above 
automatically imply that if (cf ,c|) is the unique solution of 
Q, then |6]l holds true. 

Steps 1 and 2 together establish the first two claims of 
Theorem [JJ 

Step 3: Establishing the third claim of Theorem[TJ 
Given c s , the expected payoff of a job from class % with 
waiting cost c < cf form participating in the spot market 
is Vi — L w(t;c s )dt. Since c s satisfies |6]), the expected 
payoff is nonnegative. The pricing rule |4]) ensures incentive 
compatibility for c < cf . We only need to show that if c > 
cf , the job does not participates in the spot market. Since 
w(t; c s ) = for t > c\, reporting a waiting cost larger 



than cf does not improve the waiting time of the job, and 
the expected payment is at least m(cf ). Hence, if a job with 
waiting cost c > cf decides to participate in the spot market, 
it will (mis)report a waiting cost c £ [0, cf]. The expected 
payoff of the job is Vf — cw(c; c|, c|) — m(c). Then, 

Vi — cw(c; cf , c 2 ) — m(c) 

= Vi - cfw(c; cf , cf,) - m(c) - (c - cf )w(c; cf , cf,), 
<Vi- cfw(cf ; cf , cf,) - m(cf ) - (c - cf )w(c; cf , c|), 
= -(c-cf) W (qcf,c^) < 0. 

The first inequality is from the IC constraint |3]l and then 
last equality is because the cutoffs (cf , c 2 ) are the solutions 
of (RJ. Hence the expected payoff of a job with waiting cost 
c > Cj from participating in the spot market is negative and 
it will not participate. 

Steps 1 — 3 complete the proof of Theorem[TJ ■ 

B Proof of Theorem g 

The cutoff vector c(p) must satisfy the following constraints: 



v * - Jo w & c (p)) dt ^ and nT \ 
- / C w(t; c(p))dt >v i -^forc< Ci {p). (i 



v 



Hence either, 



or, 



i -^ i(p) U ;(i;c(p))dt = 0, 
i - ^ < for c £ [ci(p),nvi - p], 

^ >v,- j c / p) w{t-c(p))dt<md 



p+c 



> for c £ [ci(p),ixvi - p]. 



(18) 

Constraint ( ff7| says that the jobs with waiting cost below the 
cutoff get nonnegative expected payoff from participating in 
the spot market. Moreover, this expected payoff is strictly 
higher than that from participating in PAYG. Constraint ( ff8] l 
says that either no jobs from a class i participate in PAYG, 
or jobs split between the spot market and PAYG with those 
above the cutoff weakly preferring PAYG. 

We next show that the choice of the cutoff vector c(p) in 
Theorem [2] uniquely satisfies ( fT7] i and ( fTS) ). For notational 
convenience, define 



(x 1 ,x 2 ,p) 



P + Xi 



w(t; Xi, x 2 )dt. 



(19) 



The function <p(xi,x 2 ,p) is continuous, decreasing in x\, 
decreasing in X2, and increasing in p. Continuity, increas- 
ing in p, and decreasing in X2 are immediate. By consid- 
ering xi > Xi, and using u>(t;xi,x 2 ) > w(t;xi,x 2 ) and 
w(t;xi,x 2 ) > 1/fifort < xi, we can show that </>(xi,X2,p) > 

<j){x!,X 2 ,p). 

Case 1: p £ (0, \iv 2 — c]. 

Step la: Existence of the solution to the equations gov- 
erning the choice of c(p). 

We equivalently need to show that there is unique x such 
that 0(x, x, p) = 0. The argument above implies that 0(x, x, p) 
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is decreasing in x. Notice that 0(0, 0,p) > and 



(c,c,p) 



w(t; c, c)dt 



- v 2 < 0. 



Hence, there is unique x € (0,c] such that 4>(x,x,p) = 0; 
denote it by x(p). Since </>(x, x,p) is increasing in p, x{p) 
is increasing in p. x(p) — > as p — > and x(p) = c for 
P = p«2 - 5. Set ci(p) = c 2 (p) = x(p). 

Step lb: c(p) satisfies the constraints ( fTT) and ( fTS) . 

Since ci(p) = c 2 (p) < c, Vi~ w(t; c(p))dt > for any 
c < Ci(p). Also from the above argument, for any c < Ci{p), 
v i ~ Jo w (^> c (p))dt > v i — (p + c )//i, where the equality 
holds only at c = Ci(p). For c > Ci(p), w(c;c(p)) = 
hence Vi — f Q w(t;c(p))dt = Vi — (p + c)/fj.. Moreover, 
v i - (P + c)//x > for c e [ci(p), /iWi - p]. 

Step lc: Characterizing equilibrium. 

This follows immediately from Steps la and 16. A job 
from class i with waiting cost c participates in the spot mar- 
ket if and only if c < Cj(p); it participates in PAYG if 
(kip) <c</j,Vi-p. 

Case 2:pe {^v 2 — c, /ii>i — cj]. 

Step 2a: Existence of the solution to the equations gov- 
erning the choice of c(p). 

If (xi, x 2 ) is a solution of ( fTO) such that X\ > x 2 then 
Xi > c and x 2 < c; otherwise J^ 2 w(t; xi, x 2 )dt = v 2 
cannot hold. Let y(x\) be as defined in Appendix |A| for 

x\ e [c,//ui]. 

We show that the function <fi(xi, y(xi),p) is decreasing in 
xi for xi € [c, fiVi]. To see this, consider x\ > x\. Since 
y(cci) is decreasing in a; i, [y(xx),X\\ C [y(xi),o;i]. Then, 



(xi,y(xi),p) - (f>(x 1 ,y(xi),p) 

X\ — Xi 



w(t]xi,y(xi))dt 

te[s/(zi),£i]\[«/(>i):2!i] 

(w(t; xi,y{xi)) - w(t; xi, eft, 



< 



(u>(f; xi, y(xi)) - to(t; x i; y(xi))) dt < 0, 



y(*i) 



where the first inequality is because w(t; x±,y(xi)) > 1/fJ, 
for t < xi, and the last inequality is from Lemma|4] 
Next, notice that 

<P(c,y(c),p) = 0(c,c,p) = v 2 > 0, 

;« 

0(c?,y(c?),p) = #cJ,cS,p) = - Vl < 0. 

A* 

Hence there is unique a; i € (c, cf] satisfying </>(xi, y(xi),p) = 
0; denote it by Xi(p). Since 0(xi, y(xi),p) is increasing in 
p, X\{p) is increasing in p, implying that y(xi(p)) is de- 
creasing in p. It can be verified that (xi(p),y(xi(p))) — 
(c,c) forp = fiv 2 - c, and (xi(p), y(xi(p))) = (cj,c|) for 
p = pui - cf. Set ci(p) = xi(p) and c 2 (p) = y(xi(p)). 
Step 2b: AiFi(ci(p)) + A 2 i^ 2 (c 2 (p)) is increasing in p. 



Consider p > p, implying c 2 (p) < c 2 (p). Suppose 

AiF 1 (ci(p)) + A 2J F 2 (c 2 (p)) < A 1 F 1 (c 1 (p)) + A 2J F 1 2 (c 2 (p)). 

Then from Lemma [4] iu(t; Ci(p, c 2 (p)) < iy(t; ci(p, c 2 (p)) 
for any i < c 2 (p) . Hence, 

c 2 (p) r£2(p) 

u;(t;ci(p,c 2 (p))dt < / w(t;a(p,c 2 (p))dt 
o Jo 

< / w{t;ci{p,c 2 (p))dt = v 2 , 
Jo 

which is a contradiction. 

Step 2c: c(p) satisfies the constraints ( [T7| ) and ( fT~8] >. 

Here, w 2 = J^ 2(p) w(t;c(p))dt, and (p + ci(p))//i = 
/ Cl(p) W (t;c(p))di. 

First, focus on class 2. Clearly, v 2 — J Q w(t; c(p))dt > 
for any c < c 2 (p), where the equality holds only for c = 
c 2 (p). Since (p + c)//i — w(t; c(p))dt is decreasing in c, 
fore < c 2 (p) < ci(p), we must have v 2 — w(t;c(p))dt > 
v 2 — (p+c)/p; fore > c 2 (p), we have v 2 — f^ w(t; c{p))dt < 
0, implying v 2 - (p + c)/^ < 0. 

Next, focus on class 1. The argument above easily implies 
that v\ — Jq w(t; c(p))dt > V\ — (p+c)//i for any c < ci(p) 
where the equality holds only for c = ci(p). Also, for c < 
ci{p) < c i. (P + C )/M > J C c (p)) dt > implying 



. , ,. p + c 
c{p))dt > Vi > Vi 



^ >0. 



Also, for any c > ci(p), w(c;c(p)) = l//i. Hence, v\ — 
J w(t;c(p))dt = vi — (p + c)//i because equality holds 
for c = ci(p). Moreover, vi — (p + c)/fi > for c £ 
[d(p),^Vi -p]. 

Step 2d: Characterizing equilibrium. 

This follows immediately from Steps 2a-2c. A job from 
class 1 with waiting cost c participates in the spot market if 
and only if c < c\ (p); it participates in PAYG if c\ (p) < c < 
/it>i —p. A job from class 2 with waiting cost c participates in 
the spot market if and only if c < c 2 (p); it never participates 
in PAYG. 

Case 3: p > [iv\ — c\. 

The only thing to prove here is equilibrium characteriza- 
tion which in turn is implied if we show that c(p) satisfies 
the constraints ( fT7] i and ( [IS) . 

Here, c^p) = cf,c 2 (p) = c^andvi = J^ 1 ^ w(t;c(p))dt. 
Then, it immediately follows that — f° w(t; c(p))dt > 
for c < Ci(p), where the equality holds only at c — Ci(p). 
Since (p + c x {p))/n - / Q Cl(p) c{,c s 2 )dt > and (p + 
c)//x — w(t;c(p))dt is decreasing in c, we must have 
Uj — Jq w(t;c(p))dt > Vi — (p + c)/^iforc < Cj(p). More- 
over, for c > Ci(p), «i — J ° w(t;c(p))dt < 0, hence, we 
must have — (p + c)//i < 0. 

Thus, a job from class i with waiting cost c participates in 
the spot market if and only if c < Ci(p); it never participates 
in PAYG. 
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This completes the proof of Theorem[2] ■ 
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